Piecewise regression analysis through information criteria using mathematical programming

A regression tree approach using mathematical programming

Regression analysis is a machine learning approach that aims to accurately predict the value of continuous output variables from certain independent input variables, via automatic estimation of their latent relationship from data. Tree-based regression models are popular in literature due to their flexibility to model higher order non-linearity and great interpretability. Conventionally, regres...

Best Regression Model Using Information Criteria

On the relationship between regression analysis and mathematical programming

The interaction between linear, quadratic programming and regression analysis are explored by both statistical and operations research methods. Estimation and optimization problems are formulated in two different ways: on one hand linear and quadratic programming problems are formulated and solved by statistical methods, and on the other hand the solution of the linear regression model with con...

Estimation of B-spline Nonparametric Regression Models using Information Criteria

Nonparametric regression modelling has received considerable attention and many methods have been proposed to draw information from data with complex structure. We consider the use of B-spline nonparametric regression models estimated by penalized likelihood methods. A crucial point in constructing the models is in the choice of a smoothing parameter and the number of knots, for which several a...

Parametric Regression Through Genetic Programming

Parametric regression in genetic programming can substantially speed up the search for solutions. In this paper parametric regression is applied to a minimum-time-to-target problem. The solution is equivalent to the classical brachistochrone. Two formulations were tried: a parametric regression and the classical symbolic regression formulation. The parametric approach was superior under a wide ...